Skip to content

Avoid store mixing for different paths#9

Merged
SergeiPatiakin merged 5 commits into
mainfrom
fix/store-mixing
Apr 24, 2025
Merged

Avoid store mixing for different paths#9
SergeiPatiakin merged 5 commits into
mainfrom
fix/store-mixing

Conversation

@SergeiPatiakin
Copy link
Copy Markdown

@SergeiPatiakin SergeiPatiakin commented Apr 23, 2025

With REST vended credentials, object store instances should not be reused for different table paths. This is because the vended credentials for s3://some-bucket/table-1 might not have access to s3://some-bucket/table-2.

In this PR we produce a fake object store URL derived from the path. This means different table paths get different object store instances.

@SergeiPatiakin SergeiPatiakin requested review from a team and gruuya April 23, 2025 08:44
Comment thread datafusion_iceberg/src/table.rs Outdated
@SergeiPatiakin SergeiPatiakin marked this pull request as ready for review April 23, 2025 10:52
@SergeiPatiakin SergeiPatiakin requested a review from mildbyte April 23, 2025 10:52
@SergeiPatiakin SergeiPatiakin merged commit bfbb8f2 into main Apr 24, 2025
2 checks passed
@SergeiPatiakin SergeiPatiakin deleted the fix/store-mixing branch May 27, 2025 08:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants